You are here : Home > Projet HELIAUS

Europe


HELIAUS

The aim of the HELIAUS project is to develop a reliable system that upgrades existing perception systems (incorporating only visible imaging, LIDAR and RADAR detection) by adding thermal vision inside and outside the vehicle passenger compartment in all light and weather conditions.



Published on 7 May 2021


Thermal Vision Augmented Awareness


The aim of the HELIAUS project is to develop a reliable system that upgrades existing perception systems (incorporating only visible imaging, LIDAR and RADAR detection) by adding thermal vision inside and outside the vehicle passenger compartment in all light and weather conditions.





 

Starting date : Avr. 2019 > Mar. 2022

Lifetime: 36 months


Program in support : H2020-ECSEL-2018-2-RIA-two-stage


 

Status project : in progress


CEA-Leti's contact :

Patrick Leduc

Laurent Fulbert

 

Project Coordinator: LYNRED (FR)

Partners:  

  • DE: DENSO ADAS Engineering Services GmbH, Fraunhofer IPT
  • FR: Another Brain, CEA-Leti, CNRS, ONERA, LYNRED, Umicore
  • IE: XPERI Limited, National University of Ireland Galway
  • IT: Next2U s.r.l.


Target market: n/a


Investment:  € 28.2 m.

EC Contribution€ 0.8 m.



Website


Stakes

  • CEA-Leti objectives two years hence:
Validation of an innovative microelectronic process underlying the used of foundry-compatible equipment and processes for a high-performance infrared microbolometer. This work is prompting:
- Design of a new pixel architecture
- Assembly of a new pixel process

Assessment of the advantage of new LWIR thermal systems by integrating novel IR sensors into camera modules with embedded processing, which includes:
  • Development and implementation of conventional machine learning techniques and new neuro-based classifiers
  • Application-related appraisal of the advantages and limitations of IR thermal sensors compared with other sensor technologies especially LIDAR and RADAR
  • Feedback on possible development of IR thermal sensors for enhancing complementarity with other sensor technologies to ensure safer environmental perception
  • Improvement of existing CEA 3D detection algorithms by incorporating 2D IR thermal imaging as an additional data source.

OBJECTIVES

  • Within the scope of Smart Mobility, anticipated vehicle driving practices and usages require reliable, affordable and versatile perception systems, which must be accurate and reliable in relation to events inside and outside the vehicle passenger compartment. Monitoring of the vehicle’s driver, passengers and its surrounding environment in all light and weather conditions must be improved and today’s perception systems (based mainly on visible imaging, LIDAR and RADAR detection) must be upgraded to include thermal sensing. The latter technology, especially in the LWIR (6 - 14 μm) bandwidth, provides valuable additional information and is considered essential to the next generation of L4 (‘’Eyes off’’) and L5 (‘’Mind off’’) autonomous driving systems.

  • In this context, the HELIAUS project will deliver breakthrough perception systems for monitoring the vehicle’s driver, passengers and surrounding environment based on smart thermal sensing. These novel perception systems will extend current technology to include operation in the LWIR bandwidth.

The overall objectives of the HELIAUS project are to:

  1. Develop cutting edge, cost effective technologies leading to cheap, high-performance LWIR modules
  2. Specify, develop, test and validate first prototypes of thermal perception systems operating inside and outside the passenger compartment
  3. Quantify thermal sensing’s valuable addition to the current and future systems
  4. Promote the benefit of such systems for smart mobility and, in particular, for future autonomous vehicles.The HELIAUS project is a first and essential step towards building cheap, industrialized thermal perception systems. The project is contributing to global competitiveness of European industry since it forms part of IPCEI Microelectronics, in which LYNRED is leading a «Smart Sensors»-based project.


IMPACT

  • HELIAUS’ technological and scientific impacts result from creation of know-how in IR microbolometer fabrication and development of innovative IR smart modules.

  • The project’s application impact results from vehicle passenger compartment and surrounding environment perception developments and assessments, and availability of a cheap, high-performance IR module with
    embedded processing. Large volumes of the latter unit can be produced in Europe and integrated into vehicles to ensure safer transport and smart mobility, thereby reducing road accidents and casualties.